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Abstract 



If you recommend a product to me and I buy it, how much 
should you be paid by the seller? And if your sole interest 
is to maximize the amount paid to you by the seller for a 
sequence of recommendations, how should you recommend 
optimally if I become more inclined to ignore you with each 
irrelevant recommendation you make? Finding an answer to 
these questions is a key challenge in all forms of marketing 
that rely on and explore social ties; ranging from personal 
recommendations to viral marketing. 

In the first part of this paper, we show that there can be 
■no pricing mechanism that is "truthful" with respect to the 
seller, and we use solution concepts from coalitional game 
theory, namely the Core, the Shapley Value, and the Nash 
Bargaining Solution, to derive provably "fair" prices for set- 
tings with one or multiple recommenders. We then investi- 
gate pricing mechanisms for the setting where recommenders 
■have different "purchase arguments". Here we show that it 
might be beneficial for the recommenders to withhold some of 
their arguments, unless anonymity-proof solution concepts, 
such as the anonymity-proof Shapley value, are used. 

In the second part of this paper, we analyze the setting 
where the recommendee loses trust in the recommender for 
each irrelevant recommendation. Here we prove that even if 
the recommendee regains her initial trust on each successful 
recommendation, the expected total profit the recommender 
can make over an infinite period is bounded. This can only be 
overcome when the recommendee also incrementally regains 
trust during periods without any recommendation. Here, 
we see an interesting connection to "banner blindness" , sug- 
gesting that showing fewer ads can lead to a higher long-term 
profit. 
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1 Introduction 

Suppose you buy a new mobile phone and, simply because 
you like it so much, you recommend it to friends, encouraging 
them to purchase it as well. Even if you do not recommend 
it out of monetary reasons, what would be an adequate and 
fair price for the phone manufacturer to pay for your recom- 
mendation? If, on the other hand, you recommend a book at 
Amazon solely due to the monetary incentive given by Ama- 
zon's referral schem^ and your friends realize this, then they 
are likely to lose trust in your recommendations. Assuming 
your friends regain trust whenever you make a relevant rec- 
ommendation, how can you maximize your long-term profit, 
and is this profit bounded or not? These are the two main 
research questions we address in this work. 

The importance of "word-of-mouth" (WOM) as a market- 
ing channel has long been known [7] [THE)]. According to [7], 
"WOM was seven times as effective as newspapers and mag- 
azines, four times as effective as personal selling, and twice 
as effective as radio advertising in influencing consumers to 
switch brands". WOM is the causal effect behind "brand 
congruence" where friends both in offline [3Tj and online [36] 
social networks tend to use the same products. Recently, a 
platform called Friend Vouch [12] was founded around the 
idea of personal recommendations. Users of the service can 
become "brand ambassadors" who get paid for putting com- 
panies in touch with friends. Whether any personal touch 
is retained in such a system or whether the person in the 
middle is not simply another marketing channel is debatable 
and in Section [1.21 we propose a classification schema to shed 
light on the differences. 

As far as the pricing of recommendations is concerned, one 
could argue that honest recommendations should always be 
given without any monetary recompensation and that cre- 
ating financial incentives could lead to a sell-out of friends. 
Although this is a valid concern, we argue that it might still 
be worth paying recommenders, even if these are not asking 
to be paid. First, even though you might not be profit- 
maximizing in a strict sense you are probably more inclined 
to mention a certain product if there is some kind of recom- 
pensation: you might be honest enough not to recommend a 
bad product over a good one for financial reasons, but you 
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are still more likely to recommend a good product if you 
get reimbursed. Second, a fair compensation can lead to in- 
creased brand loyalty. If you are already satisfied with the 
product then the feeling that the company recompensates 
you in a fair and adequate manner is likely to increase your 
positive attitude towards the company. On the other hand, 
if you are only offered $1 for recommending a particular type 
of sports car then this might be viewed as "offensive" and is 
arguably worse than not being offered any recompensation. 

Especially, as the issue of trust is of utmost relevance in 
the realm of personal recommendations, we believe that "fair 
pricing" is a cornerstone [32l[24]H Google e.g. advertises its 
Adsense program by claiming to use a Second-Price Auction 
to eliminate "that feeling that you've paid too much"[| In a 
similar spirit, our work on pricing recommendations can be 
viewed as trying to eliminate "the feeling that you've been 
paid too little" for your recommendation. 

The second problem we study, relates to scenarios where 
the recommender is selfish and only makes paid recommenda- 
tions to maximize her own profit. Here, in a sense, the friend 
making the recommendation is no more trustworthy or al- 
truistic than a web search engine showing sponsored search 
results. In these settings we believe the trust between the 
recommender and the recommendee to be dissipating. More 
concretely we assume that with every unsuccessful recom- 
mendation the recommendee becomes more and more likely 
to ignore any "advice" given by her friend. We see this as 
closely related to "banner blindness" [H O [8] , where peo- 
ple have become so overloaded and fed up with advertise- 
ment that they stop to notice it completely. Seen from this 
angle, our findings indicate that advertisers might have to 
stop showing advertisements on a regular basis if they want 
to retain customers' trust without seeing click-through-rates 
converge to zero. 

1.1 Related Work 

Even though recommendations can be seen as just another 
form of advertising, classical methods for the pricing of ad- 
vertising, such as sponsored search auctions [21], are not di- 
rectly applicable. This is mainly due to the fact that a true 
recommendation should be altruistic and so (i) the recom- 
mender is not profit maximizing and (ii) there is only a sin- 
gle seller, as an altruistic recommender will not accept "bids" 
from multiple sellers. The differences between various kinds 
of advertising are described in Section 11.21 

The work that is most closely related to our paper is [3]. 
There the authors study the sales price of an object as part 
of a viral marketing campaign. They assume that all "con- 
verted" nodes will try to convert all of their neighbors and 
that the conversion probability depends both on the num- 
ber of neighbors converted and on the sales price. They do 
not consider the problem of how the recommendation itself 
should be rewarded. In fact, they mention the problem of 
finding optimal "cashbacks" in settings where the nodes be- 
have strategically as an open problem. 

2 Somewhat related is the phenomenon of pay-what-you-like pricing 
where people act "irrationally" and choose to pay an adequate amount 

unrig. 

3 http : //www . google . com/adsense/af s . pdf 



The problem of optimal pricing with non-social recom- 
mender systems, where the recommendations directly come 
from the potential seller, was studied in [5]. Here by "non- 
social" we mean "computer-generated" and a typical ex- 
ample would be Amazon's "Customers who bought X also 
bought Y"0. The somewhat surprising argument is that cus- 
tomers are willing to pay for relevant recommendations as 
they create "value by reducing product uncertainty for the 
customers" . In this paper, we consider the case where the 
recommendations are social and do not come from the seller 
directly. Though it is imaginable that the recommendee pays 
the recommender for a good recommendation, we do not in- 
vestigate the pricing of this possible payment. 

It should be clear that we are not addressing the problem 
of what to recommend, a problem typically encountered by 
stores such as Amazon and usually solved using "collabora- 
tive filtering" techniques [35] [17] • In the first part of this 
paper (Section [2]), we assume that the recommender recom- 
mends an item because she believes this item to be of interest 
to the recommendee, and the algorithm used by her to de- 
termine potential interest is irrelevant. In the second part 
(Section [3]), the recommender is profit maximizing and now 
only cares about the reward offered to her by the seller and 
the probability p that the recommendee will buy the item. 
In this model the "what" is absorbed into p and the recom- 
mender simply decides on when to recommend. 

We are also not addressing the topic of how rumors spread 
through social networks, or how to identify the best nodes 
to target for a viral marketing campaign [TQl [19] • Our work 
focuses on a single atomic link in the corresponding cascades 
of conversions and, in the first part, we ask what a fair price 
should be to pay a node for activating one of her neighbors. 
In answering this question we limit our attention to the im- 
mediate profit of the seller due to the individual sale, and 
we do not consider the additional value due to recommenda- 
tion cascades caused by the newly activated node. However, 
given any algorithm to compute this "higher order" profit, 
it can trivially be incorporated into our results. The ques- 
tion whether a selfish node should actually try to activate 
her neighbors at all is addressed in Section [3] 

More generally, in the second part we look at a model 
where the recommendee loses trust in the recommender, i.e. 
for each unsuccessful recommendation she becomes less and 
less inclined to listen to any further suggestion. This is most 
likely to appear when the recommendee has the feeling that 
the recommendations are "dishonest". How honest recom- 
mendations can be ensured when there are several recom- 
menders is studied in [14]. The approach suggested by the 
authors involves evaluating/ranking recommenders based on 
the rating given to their recommended items by other people. 
This motivates recommenders to give good recommendations 
in a similar way that Ebay's rating system gives incentives 
for both buyers and sellers "to behave" . This approach, how- 
ever, requires a public market where potential buyers can 
look for recommendations. This is not the setting of per- 
sonal recommendations considered here. 

The problem of trust decay is related to "banner blind- 
ness" [HIHJ1E], where web users become "blind" to banner ads 

4 http : //www . amazon . com 
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due to overexposure. Cast to this setting our mathematical 
model suggests that, even if web users' interest is "refreshed" 
by a single relevant advertisement that is clicked, the long 
term profit of advertisers will stagnate as click-through-rates 
fall to zero. The only possible way out of this dilemma is 
to stop showing banner ads for a while so that users can 
"unlearn" to ignore all advertising. This approach is also 
suggested in a recent patent [3D]. 

In typical literature on sponsored search auctions [2T1 [20] 
it is assumed that the web search engine is optimizing its 
expected profit and that its expected profit for showing a 
particular ad is the ad's click-through-rate (CTR) multiplied 
by the price the advertiser will be charged when her ad gets 
clicked. Usually, only a single round is considered or, when 
there are budget constraints [H [11] , the CTRs are assumed 
to be constant during the duration of the game. If, however, 
it is assumed that CTRs drop for all ads for each unsuc- 
cessful advertisement shown then, in the long run, this puts 
more emphasis on showing ads with high CTR, regardless of 
how much their advertisers can be charged for a single click. 
Although different objective functions for the search engine 
have been considered [I], the setting of profit maximization 
with trust decay has not been studied and we deem this an 
interesting area for future work. 

Finally, there is previous work that is relevant on a more 
technical level. In particular solution concepts such as the 
Core [T5l [26] or the Shapley- Value [33, 26 j have been studied 
extensively before. The exact connection to this group of 
work will be made clear in the sections with our technical 
contributions. 

1.2 Classification of Advertising Schemes 

One could argue that a recommendation is, ultimately, just 
an advertisement and that an advertisement is just a rec- 
ommendation. To highlight the differences between different 
kinds of advertisement in general, we present a simple clas- 
sification scheme. 

• Addressing: Personal vs. general. A recommendation is 
per se more personal than an advertisement and should 
be adapted to reflect the individual needs and interests 
of the potential buyer. Classic advertisement is not per- 
sonalized and uses the same "message" for everyone. 

• Trust: High vs. low. A recommendation should come 
from someone the potential buyer trusts and feels loyal 
or close to. This can be a personal friend or maybe 
a well-respected blogger. In classic advertisement the 
information source is viewed as less reputable, though 
advertisers try to use trusted icons for their purposes. 

• Intention: Altruistic vs. commercial. The intention of 
a recommendation by a friend is generally not commer- 
cial. She might not get reimbursed at all but she still 
recommends something as she believes you would profit 
from it. In ordinary advertising the reason for the act 
of advertising itself is a commercial one. 

The first part of this paper (Section [2]) considers the setting 
of personal, highly trusted and altruistic recommendations. 
The second part (Section^ then investigates the case of still 



personal, but commercial recommendations with a decaying 
amount of trust involved. To demonstrate the general ap- 
plicability of this schema, we use it to classify a number of 
different advertising scenarios. 

1. Billboards. A chain of pizza restaurants puts up bill- 
boards all over the country, without targeting any spe- 
cific group. Addressing: general, trust: low, intention: 
commercial. 

2. Sponsored search. A web search engine shows targeted 
sponsored results in addition to "organic" web search re- 
sults, trying to match the searcher's intent. Addressing: 
personal, trust: low, intention: commercial. 

3. Testimonial. You liked a book and you write a testimo- 
nial on Amazon to convince other unknown readers to 
read it, too. Addressing: general, trust: high, intention: 
altruistic. 

4. Direct recommendation. A friend asks you for advice 
on which laptop to buy and you recommend the model 
which you believe is best for her. Addressing: personal, 
trust: high, intention: altruistic. 

Of course, there are lots of other important differences, 
e.g. concerning the conversion rates, but we view these dif- 
ferences as consequences of the "axiomatic" differences above 
and we assume that a personalized, altruistic "advertise- 
ment" from a highly trusted source will always have a higher 
conversion rate than a general, commercial "recommenda- 
tion" from a disreputable source. 



addressing 




Figure 1: Visualization of the four advertising schemes dis- 
cussed in the text. Direct recommendation (#4) is the 
most successful advertising medium as it dominates all other 
schemes in all dimensions. 



1.3 Our Contributions and Outline 

To the best of our knowledge there has been no work focusing 
on either (i) the pricing of recommendations (our Section [2]) 
or (ii) the strategic behavior of recommenders in a setting 
with decaying trust (our Section [3]). We view the introduc- 
tion of these problems as one of our contributions. 
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As far as the pricing of recommendations is concerned we 
prove that there can be no pricing mechanism that is "truth- 
ful" with respect to the seller fSection l2.ip . This shows that 
the seller can always pretend to profit less from the recom- 
mendations than she actually does to get a larger piece of the 
pie. We then apply solution concepts from coalitional game 
theory, namely the Core, the Shapley value, and the Nash 
Bargaining Solution, to determine provably "fair" prices. For 
the Core we find that it typically contains all "individual ra- 
tional" payoff vectors, including the payoff vector where the 
seller gets everything and the recommenders get nothing. On 
the one hand, this demonstrates the weakness of the recom- 
menders: They cannot form a coalition with non-zero value 
without the seller. On the other hand, it shows that the 
Core is essentially useless for deciding how to distribute the 
"extra profit" the seller can expect from being recommended 
among the recommenders (Sections 12. 2. II and 12. 3. ip . For the 
Shapley value we find that it not only defines unique prices, 
but that these prices are also "fair" in a very intuitive way: 
The price of a recommendation should be proportional to 
the "extra profit" the seller can expect from it (Section l2.2.2l 
and I2.3.2P . For the Nash Bargaining Solution we find that 
it yields "fair" prices, namely those obtained by the Shap- 
ley value, only if there is a single recommender. Otherwise, 
especially in situations where the recommenders do not con- 
tribute equally to the "extra profit" of the seller, it may lead 
to "unfair" prices (Section 12.2.31 and I2.3.4P . Finally, we also 
consider the case where each recommendation consists of one 
or more "purchase arguments" . Here the ordinary Shapley 
value is no longer the method of choice, as withholding argu- 
ments might be beneficial for the recommenders. We show 
how the anonymity-proof Shapley value from [28] can be ap- 
plied to overcome this problem (Section I2.3.3P . 

In the second part on the strategic behavior of profit max- 
imizing recommenders we first show that, not surprisingly, 
the total expected profit of the recommender is bounded 
when the recommendee can only lose and does not regain 
trust (Section 13. 2p . Then we prove that the total expected 
profit is still bounded over an infinite (!) sequence of rec- 
ommendations, even when trust is reset to an initial level 
on each successful recommendation (Section: I3.3[) . Finally, 
we show that when trust is regained incrementally when no 
recommendations are made, the recommender's optimal to- 
tal expected profit is unbounded in the long run and that 
she can recommend both too aggressively and too passively 
(Section 13. 4p . These results are also applicable to the phe- 
nomenon of "banner blindness" . 

2 The Pricing of Recommendations 

We model the pricing of recommendations problem as a coali- 
tional game with transferable payoff (N, v) , where N is a 
finite set (the set of players) and v is a function that asso- 
ciates with every non-empty subset S of N (a coalition) a 
real number v(S) (the worth of S). We use s to denote the 
seller, who is paying for recommendations, and to denote 
the i-th recommender. There is exactly one product for saleU 

5 Note that this does not restrict the generality of our model. It 
rather says that each recommendation is for a distinct entity that we 



For each coalition S the number v (S) is the total payoff that 
is available for division among the members of S. We use 
5 > to denote the seller's margin or gain from selling the 
product, i.e. the sales price minus the production cost, and 
distinguish three scenarios for v: 

• General. Without any recommendation the product is 
sold with probability p G [0, 1]. If the recommenders R C 
{ri, .., r n } recommend the product, then the probability 
that the product is sold is p + f({s} U R), where / : 
2 N — > [0, 1 — p] is an arbitrary function with /({s}) = 0. 

The following two scenarios are special cases of General. 

• Linear. Without any recommendation the product is 
sold with probability p G [0,1]. The recommendation 
of the i-th recommender increases this probability by 
qi G [0, 1 — Qj]- The joint effect of more than one 
recommendation is the sum of the effect of the individual 
recommendations. Formally, if the recommenders R C 
{ri, .., r n } recommend the product, then the probability 

• Threshold. If less than k recommenders recommend 
the product, then the product is sold with probability 
p G [0,1]. If at least k recommenders recommend the 
product, then it is sold with probability p + q where 

ge[0,i-p]. 

We refer to these scenarios as (N,v) (General), (N,v) (Lin- 
ear), and (N,v) (Threshold). The following table gives the 
worth v(S) of all S C N = {s, r\, r 2 } for all three scenarios. 
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Table 1: Worths v(S) of all possible coalitions S for one seller 
s and two recommenders r\ and r2 for our three different 
models. 



Our goal is to find a payoff vector {x s , x ri , . . . x rn ) , where 
x s denotes the expected payoff to the seller and x Ti denotes 
the expected payoff to the i-th recommender. Suppose that 
the seller s is recommended by all recommenders G -/V\{s}, 
then the worth of this coalition is v(N) = (p+ f(N)) ■ 5. We 
say that the payoff vector (x s feasible if x s + 

J2i x ri — v(N). A feasible payoff vector, which prescribes 
the expected payoff to each player, can be translated into 
prices, i.e. payments from the seller to the recommenders, 
as follows: 

1. Pay-per-Recommendation: The recommender gets paid 
by the seller for every recommendation; successful or 
not. That is, on every recommendation the seller s pays 
the i-th recommender the money equivalent of x Ti . 

refer to as a product. 
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2. Pay -per- Sale: The recommender gets paid by the seller 
for successful recommendations only. That is, on every 
successful recommendation the seller s pays the i-th rec- 
ommender n the money equivalent of l/(p + /(JV)) -x n . 

In practice, the Pay-per-Sale approach might be preferable 
as, on a successful recommendation, one could reasonably as- 
sume p + f(N) = 1, sidestepping the problem of estimating 
f(N) with very little or no data. Note that the prior prob- 
ability p is easier to estimate using the seller's sales record 
and click-through or conversion-rates. 

2.1 Impossibility Result 

Ideally, the payoff vector (x s , x ri , . . . , x Tn ) computed by 
whatever mechanism should give the seller s, who holds 
the private information on p, f, and 5, the incentive to 
reveal her information truthfully. Formally, we want that 
for all p' , /', and 8' : x s (p,f,8) > x s (p' , /' ,6'), where 
x s (p, f,S) = (p+/(W)H-5>r«(p, f,S) and ^(p*, /',*') - 
(p + f{N)) ■ 5 - Ei av 4 (p', /', 8'). Unfortunately, as the fol- 
lowing theorem shows, the only truthful payoff vector has 
Ei x ri = 0. That is, the seller gets everything and the rec- 
ommenders get nothing. 

Theorem 1. There can be no truthful payoff vector (x s , x ri , 
. . . , x Tn ) that has E . x ri ^ and ensures participation of the 
seller s and the recommender s T\ to r n . 

Proof. To ensure participation for the seller, we must have 
x s (p, f, S) = (p + f(N)) -S-J\ a*,(p, f,S)>0 for all p, 
/, and 8. To ensure participation for the recommenders r\ 
to r n we must have Y^iX ri {p, f ,8) > for all p, f, and 
8. Now suppose (x s , x ri , ...,x rn ) with Y). x Ti ^ was 
truthful. It follows that x s (p,f,6) > x s (p', f',8') for all 
p', /', and 8', i.e. (p + f(N)) • 5 - (p, /, *) > (p + 

/(J\0) • S - Y2i Xr t (p', /', S'). And hence, E, x u (p' , /', 5') > 
Y2iX ri (p, f,8). But since Ei (?■> ft $) > there must be 
p', /', 8' such that(p' + f'(N)) ■ 8' < Y2i x ri(pJ,t) with 
E 4 z r< (p', /', 5') < (p' + f'(N)) ■ 5' < E» ^ s (p, /, <$)• Contra- 
diction! □ 

2.2 One Recommender 

We begin by studying the problem of finding "fair" prices 
in the setting N = {s,r}, i.e., there is only one seller and 
one recommender. In this setting the games (N, v) (Linear) 
and (N, v) (Threshold) are equivalent. We discuss the so- 
lution concepts Core, Shapley value, and Nash Bargaining 
Solution. For a more detailed discussion of these solution 
concepts see [23 [22] ■ 

2.2.1 The Core 

The Core [TS] of a coalitional game is an outcome of coop- 
eration among all players where no coalition of players can 
obtain higher payoffs for all of its members. A payoff vector 
in the Core is "fair" in the sense that no subset of players 
can justifiably argue that they are paid to little, as they are 
unable to achieve higher payoffs on their own. 



More formally, the Core of the game (N, v) is the set of 
feasible payoff vectors {xi)i^N for which there is no coalition 
S C N and S-feasible payoff vector (y,)i g Ar such that y,; > Xi 
for all i G S. Recall that a payoff vector (xi)igjv is feasible if 
Eieiv x i = v(N). It is S-feasible if J2 ieS x t = V(S). 

The Core can be shown to be non-empty by means of 
the Bondareva-Shapley Theorem JS[ [33], which states that 
a game has a non-empty core if and only if it is balanced. 
A game (N, v) is balanced if for every balanced collections 
of weights (Xs)scn'- Es-^s ' V (S) ^ v(N). A balanced 
collection of weights (Xs)scn is a collection of numbers 
Ag G [0, 1] (one for each coalition S C N) such that for 
all i: EscN:i£S X s = 1- 

Theorem 2. The game ({s,r},v} (General) has a non- 
empty core. 

Proof. Let x £ [0,1]. All balanced collections of weights 
{^s)scn are of the form Xs — x for S — {s},{r} and 
As — 1 — x for S = {s, r}. By the Bondareva-Shapley The- 
orem, the Core is non-empty if and only if for all values 
x e [0, 1] : 

x ■ («({»}) + «({r})) + (1 - x)v({s, r}) < v({s, r}). 

For x = this is trivially true. Next we we analyze the case 
x > 0. Since v({r}) = and v({s, r}) — v({s}) = f(s, r) ■ 8, 

x ■ v({s}) — x ■ v({s,r}) <0 
<^ v({s,r}) - v({s}) >0 
^f({s,r})-6 >0. 

Since /({s, r}) > and 8 > this is always true. □ 

Recall that the games (N, v) (Linear) and (N, v) (Thresh- 
old) are special cases of the game (N, v) (General) and so 
Theorem [2] also shows non-emptiness of the Core for these 
games. Next we give necessary and sufficient conditions for 
a payoff vector (x s , x ri , . . . , x Tn ) to be in the Core. 

Theorem 3. The payoff vector ((p + f({s,r}))8 — x,x) is in 
the Core of the game {{s,r},v) (General) if and only if: 

0<x<f({s,r})-8. 

Proof. Let x s = (p + f({s,r}))8 — x and let x r — x. If the 
vector (x s , x r ) is in the Core of the game ({s, r}, v) (General), 
then there exists no coalition S C N = {s,r} and an S- 
feasible payoff vector y = (y s ,y r ) such that yi > Xi for all 
i E S. That is, for all S C N and ^-feasible payoff vectors 
y — (y s , y r ) we have that yi < Xi for all i G S. For S = {s, r} 
this means that y s + y r = v({s,r}) < x s + x r = v({s,r}) 
(which is trivially true). For S — {s} this means that y s = 
v {{s}) = P-S <x s = {p+f{{s, r}))-8-x, i.e. x < f({s, r})-8. 
For S = {r} this means that y r = v({r}) — < x r — x, i.e. 
x > 0. That is, < x < /({s, r}) ■ 8. 

For the reverse direction assume by contradiction that < 
x < f({s, r}) ■ 8 but that (x s ,r r ) is not in the Core, i.e. there 
exists a coalition S C N — {s,r} and a S'-feasible payoff 
vector y = (y s , y r ) such that yi > Xi for all i G S. We cannot 
have S = {s,r} as then y s + y r = v({s,r}) > x s + x r = 
v({s,r}), which gives a contradiction. But if S — {s}, then 
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y s = v({s}) = p ■ S > x s — (p + f({s, r})) ■ S - x, i.e. x > 
f({s, r}) • 6, which gives a contradiction. Finally, if S = {?'}, 
then y r = v({r}) — > x r = x, i.e. x < 0, which also gives 
a contradiction. □ 

For the games ({s,r},v) (Linear) and {{s, r},v) (Thresh- 
old) this means that ((p + q)S — x,x) is in the core if and 
only if: 

< x < q ■ 8. 

This implies that any "feasible" payoff vector is in the Core. 
The only restriction on the payoff vector is that the payoff 
to the recommcnder be non-negative and in expectation no 
higher than the "extra profit" the seller can expect from the 
recommendation. In particular, a payoff vector that gives ev- 
erything to the seller and nothing to the recommender would 
be in the Core. This demonstrates the weakness of the recom- 
menders: They cannot form a coalition with non-zero value 
without the seller. 

2.2.2 Shapley Value 

One problem with the Core is that it does not assign a unique 
payoff vector to a game. This makes it necessary to have 
another criterion for choosing a payoff vector. The Shapley 
value [33 is a solution concept that assigns to each game 
a unique, provably fair payoff vector. In general, a value 
4> : v — > maps each game (N,v) to a unique vector 

4>(v); the i-th entry 4>i(y) of this vector being the expected 
payoff to player i. The Shapley value is the unique value 
satisfying the following axioms: 

1. Symmetry: If player i and j are interchangeable, then 
4>i(v) — 4>j(v). Formally, if for every S C N s.t. i G S, 
j S: v((S \ {z}) U {j}) = v(S), then = 

2. Dummy: If player i's contribution to any coalition S is 
zero, then 4>i(v) = 0. Formally, if for every S C N \ {i}: 
v(S U {i}) = v(S), then ^(v) = 0. 

3. Additivity: Player i's entry 4>i(v) should be additive in v. 
Formally, if (N, v + w) is derived from (N, v) and (N, w) 
by defining (v + w)(S) = v(S) + w(S) for all S C N, 
then <j>i(v + w) = <fii(v) + (f>i(w) for all i E N. 

These axioms can be interpreted as formalizing a notion of 
"fairness" , that postulates that the expected payoff to player 
i be proportional to player i's contribution to the outcome 
of the game. For an analysis along these lines see [25] . 

Definition 1. The Shapley value 4>{v) — (4>i{v), . . . , 4>n{v)) 
of the game (N, v) is defined as follows: 

Mv)= E Li, — — ■WSU{ l })-«(5)). 

SCN\{i} 1 '' 

One interpretation of this is: Suppose that all the players 
are arranged in some order, all orders being equally likely, 
then <pi(v) is the expected marginal contribution of player i 
to the set of players who precede her. 



Theorem 4. Consider the game {{s,r},v) (General). The 
Shapley value <f>(v) — (<p s (v), <fi r (v)) is given by 

(j) s {v) = pS +^f({s,r})5 and <p r (v) = ^f{{s,r})6. 

Proof. The claim follows from the definition of the game 
({s,r},v) (General) and Definition [1] Note that the worths 
v(S) of all S C N — {s,r} can be read from Table [T] by 
treating r\ as r and ignoring rows containing r^. □ 

For the game {{s,r},v) (Linear, Threshold) this means 
that 

<f> s (v) = pS + ^qS and <f> T {v) = ^q8. 

This shows that the payoff to the recommender should be 
proportional to her contribution to the seller's expected "ex- 
tra profit". In particular, it shows that the recommender's 
payoff should be linear in her contribution to the purchase 
probability, i.e. /({s, r}), and also in the seller's margin or 
gain S. This is consistent with "real life" pricing schemes 
that redeem the recommender with a certain percentage of 
the sales price |22j , assuming that for a given product family 
the margin is proportional to the sales price. 

2.2.3 The Nash Bargaining Solution 

The last solution concept that we discuss in this section is 
the Nash Bargaining Solution [27 ^ The basic idea here is 
to view the game (N, v) as a bargaining problem over a set 
F of feasible payoff vectors / = (/o, . . . , f n ) and a dedicated 
payoff vector d = (do, . . . , d n ); the payoff vector in case of a 
disagreement. A solution is a function <j) : (F, d) — > F. The 
Nash Bargaining Solution is the unique solution satisfying 
the following axioms: 

1. Pareto Efficiency. There is no / S F such that /$ > 
4>i (F, d) for alii € N and fj > c/>j (F, d) for at least one 

j e N. 

2. Individual Rationality. For all % G N : (j>i(F, d) > di. 

3. Scale Covariance. If F' = {(\q ■ /q + 70, . . . , A„ • f n + 
In) I (/()}•••! fn) G F} and d! = (A • do + 70, • • • , A„ • 
d n + In): then <p(F', d!) = (A • <f> (F, d) + 70, . . . , A„ • 
4> n (F,d)+^ n ). 

4. Independence of Irrelevant Alternatives. If F' C F and 
cj)(F, d) G F', then <j>(F' , d) = <f>(F, d). 

5. Symmetry. If (fo, ■ ■ ■ , fi, ■ ■ ■ , fj, ■ ■ ■ , fn) 6 F implies 
(fo, fj, -,fn) G and = dj, then 
cj> i (F,d)=cj> j (F,d). 

The Nash Bargaining solution is "fair" in the sense that is 
Pareto effcient, i.e. it is impossible to improve the payoff of 
one or more players without hurting that of others. One can 
show that it satisfies <f>(F,d) G argmaxj gF Yli(fi ~ di) p6] - 
We use this to prove: 

6 The only connection between this solution concept and the concept 
of a Nash equilibrium 26 , 29 is John F. Nash. 
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Theorem 5. For ({s,r},v) (General) let F = {(f s ,f r ) I 
fs > 0, f r > and f s + f r = { P + f({s, r})) • (5} and d = 
(d s , d r ) = (p • 5,0). Then, 

<P(F,d) = ((p+y({s,r})6,±f({s,r})6). 

For the game ({s,r},t>} (Linear, Threshold) this means 
that: 



that: 



<P(F,d) 



P+ ^9 ) 8, \q8 



This demonstrates that the Nash Bargaining Solution and 
the Shapley value coincide in our model. On the one hand, 
this is surprising as the axioms used to define the Shapley 
value and the Nash Bargaining Solution are quite different. 
On the other hand, this is intuitive as for two players there is 
only one non-trivial coalition to be considered for the Shapley 
value. So if this two-player coalition leads to a bigger payoff 
P than the sum of its two non-cooperative "atoms" , then the 
different symmetry axioms present in both solution concepts 
imply that this surplus should be divided 50-50. This holds 
as long as the feasible payoff vectors are F = {(/o, /i)|/o + 
/i < P}, and so (/o, /i) G F (/i,/o) G F, but would stop 
to hold if, e.g. there were additional constraints on F such as 
fo > 2 • f\. In such cases, the symmetry axiom of the Nash 
Bargaining Solution no longer applies. 

2.3 Many Recommenders 

Next we study the problem of finding "fair" prices in the 
more general setting TV = {s, r±, . . . , r„}, i.e. there is one 
seller and n > 1 recommenders. Note that in this setting the 
games (A, v) (Linear) and (A, v) (Threshold) are no longer 
equivalent. As in the setting where A — {s, r} we study the 
solution concepts Core, Shapley value, and Nash Bargaining 
Solution. 

2.3.1 The Core 

Recall that the Core of the game (A, v) comprises all feasible 
payoff vectors with which no coalition S C A is "unhappy" 
meaning that the players in S cannot break away to obtain 
a higher payoff on their own. For a formal definition of the 
Core (and related definitions) see Section [2. 2. II 

Theorem 6. The game (N, v) (General) has a non-empty 
core iff for every balanced collections of weights (Xs)scn' 



E [As(/(AO-/(SO)]>0. 



SCN:s£S 



Proof. Let (Xs)scn be a balanced collection of weights. 
Since v(S) — whenever s $ S, applying the Bondareva- 
Shapley Theorem |3 [34] to the game (A, v) (General) gives: 

E ^s(p + f(S))]< P + f(N). 

SCN:s£S 

Since (Xs)scn is a balanced collections of weights, we have 



E 



SCN-.seS 



Xs = 1 and A 



N 



i-E 



E x s-f(S) <f(N). 

SCN:seS 

& E ^s(f(S)-f(N))] + f(N) <f(N) 
scN-.ses 

^ E IMW)-f(S))} >o. □ 



SCN:seS 

The condition given by Theorem [6] holds trivially for (N, v) 
(General) if f(N) > f(S) for all S C N since all the X s values 
are non-negative. For the game (N, v) (Linear) and (N, v) 
(Threshold) this means that the core is always non-empty 
since qi > for all i respectively q > 0. 

Theorem 7. Consider the game (N, v) ( General). The pay- 
off vector (x s = (p + f(N)) ■ S - £V x n , x ri , . . . , x Tn ) is in 
the Core if and only if for allT C N s.t. s £ T: 

0< Y, x n<{f{N)-f{N\T))-5, 

ri£T 

Proof. Assume that the payoff vector (x s = (p + f(N)) ■ S — 
x n , x ri , . . . , x rn ) is in the Core. Since v(S) — for all 
coalitions S C N such that s £ S, it follows that: 



1. For all S C N such that s G S 



(p + f(N))S- E * 
&(p + f(N))5- E : 

ri£N\S 



E Xi 



o (f(N) - f(S))S 
2. For all S C N such that s ^ 5": 



>v(S) 

>(p + f(S))S 

> E x * 

ri£N\S 



E ^ > v{s) ^> e ^ - °- 



r 4 SS 



nes 



With T = N \ S in 1. and T = S in 2. it follows that < 



Er 



GT • 



< (f(N) - /(A \ T)) • 6 for all T C A s.t. s<£T. 



For the reverse direction assume by contradiction that < 
Er.eT x n < (/(A) - /(A \ T)) ■ 8 for all T C A s.t. s£T 



but that (x s = (p + /(A)) • S - Ei 



, a; rre ) is not 



in the Core, i.e. there exists a coalition S C A and an S 1 - 
feasible payoff vector y = (y s ,y ri , . . . , y rn ) in which > 
for all players k in S". Since y is S'-feasible, the total payoff 
Efces ^0 the players in S must equal v(S). Since y p > x p 



must have Efc G s Vk > Y. 



for all players p in S 
Thus, w(S') > Efces^fc- 

Case 1: If s e S, since = (p+ f(S))-6 and Efces 
(p + /(A))<5 — EriG^xs ^ ' this means that 



(p + f(s))-s 

E] ^rj 



>(p + /(A))<5- E x - 

nEN\S 

> (/(A) - f(S)) ■ 8. 



SCN:s£S 



Xs- It follows 



With T = N \ S this gives a contradiction to the fact that 
for all T C A s.t. s^T: E n eT s n < (/(A) - /(A \ T)) • (5. 



7 



Case 2: If s $ S, since v(S) = and J2kes Xk ~ 
Y^ r -eS x ni this means that: 

v(S) = > x n- 

With T — S this gives a contradiction to the fact that for all 
T CN s.t. s g T: Er lS T x n > 0. □ 

For the game (JV, u) (Linear) this means that the payoff 
vector (x 8 = (p + J2i n) ' $ ~ Y,i x ri , x ri , ■ ■ ■ , x r „ ) is in the 
Core if and only if for all T C N s.t. s <£ T: 



For the game (N, v) (Threshold) this means that 



0<£*r,< £ J 
r.ST Vr.GT / 



For the game (N, v) (Threshold) this means that the payoff 



vector [x s = (p + q)S - £\ a; r; , ar ri , . 
and only if for all T C N s.t. s ^ T: 



, x, n ) is in the Core if 




if \T\ < n 
if \T\ > n 



k 
■ k 



This means that for (N, v) (Linear) and (N, v) (Threshold) 
with k = n a certain payoff vector is in the core precisely if 
no coalition of recommenders receives more than their joint 
contribution to the seller's expected "extra profit" . For the 
game (TV, v) (Threshold) with k < n this means that x n = 
for all i (with T — {ri}) and, thus, the only payoff vector in 
the Core is ((p + q)5, 0, . . . , 0), i.e. the seller gets everything 
and the recommenders get nothing. 

2.3.2 Shapley Value 

Recall that the Shapley value assigns to each game a unique 
payoff vector that is "fair" as it satisifies the Symmetry, 
Dummy, and Additivity axioms. For a formal definition of 
the Shapley value (and related definitions) see Section f2. 2. 21 

Theorem 8. Consider the game (N,v) (General). The 
Shapley value 4>{v) = (4> s (v), <f> ri (v), . . . , 4 > r n ('v)) is given by 



<p s (v)=p5+ Y 

SCN\{s} 



\S\K\N\-1-\S\)\ 
I ATI! 



f(SU{s})5 



£ WI(|W| -,:- |8PI (/(5U W )-/(5) )t 



SQN\{n}: 



\N\\ 



Proof. The claim follows from the definition of the game 
(N, v) (General) and Definition [TJ The worths v(S) of all 
S C N = {s,r 1 ,r 2 } are given explicitly in Table [T] For 
\N\ > 3 the worths v(S) are obtained similarly. □ 

For the game (N, v) (Linear) this means that 



,(«) =ps + 



and 

for all i. 



4> s {v) =p6 + 



(n + iy. 



k\{n~k)\ 



and 

for all i. 



This suggests that in the game (N, v) (Linear) each individ- 
ual recommender should receive a share of exactly one half 
of her contribution to the expected "extra profit" of the rec- 
ommender. For the game (N, v) (Threshold) the fraction 
fc!(n — fc)!/(n + 1)! is exactly the fraction of times where this 
recommender's recommendation "makes a difference" . So 
all in all the Shapley value does not only give a unique pay- 
off vector, but it also yields "fair" payoffs in the sense that 
the payoff to each recommender is proportional to the rec- 
ommender's contribution to the "extra profit" the seller can 
expect. 

2.3.3 Anonymity-Proof Shapley Value 

What would be a "fair" payoff vector if each recommendation 
was a collection of arguments! A straightforward approach 
would be to compute the Shapley value on the basis of ar- 
guments and to redeem recommender r*j with J2aes- 4>a{v), 
where a is an argument from the set of arguments A and Si is 
the set of arguments that recommender r% possesses; the sets 
Si being disjoint. The problem with this approach, however, 
is that it might be beneficial for a recommender to withhold 
some of her arguments: 

Example 1. Let A — {a, 6, c}, v({a,b}) — v({a, c}) = 
v({a,b,c}) = 1, and v({a}) = v({b}) = v({c}) = v({b,c}) = 
0. Let Si = {a} and 5*2 = {b, c}. Then r\ gets <j) a (v) = \ and 
r 2 gets <j) b (v) + (j> c (v) = | + | = |. 

Example 2. Let A' = {a, b}, v({a, b}) = 1, and v({a}) = 
v ({b}) = 0- Lct Si = {a} and S 2 = {b}. Then n gets <j) a (v) = 
\ and r 2 gets <j>b{v) = \. I.e. r 2 would be better off. 

The anonymity-proof Shapley value |28j cannot be "tricked" 
in this way. It is defined as follows: 

Definition 2. For any set A' C A of declared arguments the 
anonymity-proof Shapley value ipa(v) for aei' is: 



0a (v) 



Ea'GA' <M") 



v(A'). 



So a better way to redeem the recommenders would be to 
compute the anonymity-proof Shapley value ipa{v) for each 
argument a € A' and to give each recommender J2 a es- V'a(v). 
With this approach r\ and r 2 would get ip a = 3/5 and tpb(v) + 
tpc(v) — 2/5 in Example 1 and ip a = 3/4 and ^&(u) = 1/4 < 
2/5 in Example 2. 

2.3.4 The Nash Bargaining Solution 

Recall that the Nash Bargaining Solution is defined as the 
unique bargaining solution that satisfies the axioms listed in 
Section 
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Theorem 9. For (N,v) (General) let F = {(f s ,fn, 
fm) \fs > 0, f n >0(Vi) and f s + £. f r , =(p+ f(N)) ■ 6} 
and d = (d s , d ri , . . . , d Tn ) = (p ■ 8, 0, . . . , 0). Then, 



<f> s (F,d) = (p + —-f(N))-5 
n + 1 



<Pn(F,d) 



n + 1 



f(N) ■ S. 



and 

for all i. 



Proof. The claim follows from the fact that 4>(F, d) 6 
argmax /ei? JJ^fi - di) [26]. □ 

One problem with the Nash Bargaining Solution is that 
it completely ignores the possibility of cooperation among 
subsets of players. To see that this may lead to "unfair" 
prices, consider the game (N, v) (Linear) with one seller s 
and two recommenders r\ and r2- Suppose that q\ = 1—p — e 
and that (72 = e for some some small e > 0. It follows that 
4> ri (F,d) — 4> r2 (F,d) — i.e. the expected payoff to both 
recommenders is the same. But since ri's contribution to the 
expected worth of the grand coalition is significantly higher 
than that of ri (especially as e — > 0) , this cannot be regarded 
as "fair". We conclude that for |jV| > 2 it is not advisable 
to use the Nash Bargaining Solution to guide the pricing of 
recommendations. 



3 Recommending Strategically 

We study the following problem: There are n products. For 
each product the recommender has two options: "recom- 
mend it" or "not recommend it" . A recommendation is suc- 
cessful if the buyer buys the product. For a successful rec- 
ommendation the recommender gets a constant reward of r 
and this reward is the same for all products. Initially, the 
probability p of success is po < 1. With each unsuccessful 
recommendation this probability drops from its current value 
to p = I ■ p, where I < 1 is the loss rate. The probability p 
can be seen as an estimate of the recommendee's trust in 
the recommender and a high value of / corresponds to a slow 
loss in trust. This basic model is analyzed in Section [321 We 
also consider extensions of this model where trust (= p) can 
increase again in two ways. First, we assume that p is reset 
to p — po on each successful recommendation. This setting 
we refer to as "with reset" and it is analyzed in Section [3.31 
Second, we introduce a factor g > 1 and each time the rec- 
ommender does not recommend anything trust is regained 
and p is updated to p — min(g • p,po). This setting we re- 
fer to as "with recovery" when g > 1 and it is analyzed in 
Section ET1 

In all settings the recommender's sole goal is to maximize 
the overall expected reward M n (po, I, g) for the given param- 
eters po, I and g. We are interested in the asymptotic behav- 
ior of M n (p ,l,g), i.e. in R(p ,l,g) = lim^,^ M n (p Q , I, g). 
Before looking at the theoretical analysis, the following sec- 
tion experimentally demonstrates the different behavior of 
the optimal total expected reward in these settings. 

3.1 Experimental Results 

Figure O gives experimental results for n = 200, r = 1, 
Po = 0.5, I = 0.66, g = 1 (in the setting "without recov- 



ery") and g — 1.33 (in the setting "with recovery"). It shows 
that the expected reward of the optimal strategy converges 
in the setting "without recovery" and diverges in the setting 
"with recovery". In the setting "without recovery" the ex- 
pected reward converges to 2.25 if the probability of success 
is not reset and to 5 if it is reset to po on a single successful 
recommendation. The figure also shows that the expected 
reward of the heuristic "recommend product 1, k + 1, 2k + 1, 
etc." converges for k = 2 where I ■ g k < 1 and diverges for 
k = 3 and 4 where I ■ g k > 1. Finally, it shows that the 
expected reward grows faster for k — 3 than for k = 4. 



50 ■ 



40 ■ 



10 ■ 



— 1 1 1 1 — 

optimal: w\o recovery, w\o reset 
optimal: w\o recovery, w\ reset 



optimal 
heuristic (k = 2) 
heuristic (k = 3) 
heuristic (k = 4) 



V CUUVCIJ, VV\ 

w\ recovery, w\ reset 

w\ recovery, w\ reset 
w\ recovery, w\ reset 
w\ recovery, w\ reset---"' 



20 40 60 80 100 120 140 160 180 200 
products 

Figure 2: Without any recovery (red and green lines) the 
total expected reward converges. This also holds, even with 
recovery, for the "aggressive" heuristic (purple line) which 
recommends every second item. The other three settings, 
described in detail in Section l3.1i lead to an asymptotically 
unbounded reward. 



3.2 Without Reset, without Recovery 

Here we consider the case where g = 1 (= no recovery) 
and assume that the probability of success is not reset 
to po on a successful recommendation. As the probabil- 
ity of success remains unchanged if no recommendation is 
given, the optimal strategy is to recommend all products. 
Therefore we can rewrite R(po,l) := R(po,l,l) as follows: 
R{Po, = Po(r + R(Po, 0) + (1 — Po)R{lpo, 0> which we can 
solve analytically. 



R(p ,l) 



Po 



1 -Po 

Po 



r + R{po ■ I, I) 
r+J^L r + R{po-l 2 ,l) 



1 - Po 1 - Po 

Po 
1 -Po 



Po 



1-po l-l 



r < oo. 



So, not surprisingly, if trust can only be lost and if both 
the initial trust po and the loss rate I are strictly smaller 
than 1, then the total expected reward the recommender can 
achieve is finite, even when there is an infinite sequence of 
items to recommend. 
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3.3 With Reset, without Recovery 

Now let us analyze the case where still g — 1 (= no recovery) 
but each successful recommendation leads to reset of p to po- 
Again, the optimal strategy is to recommend all products as 
there is no gain from not recommending. In this setting, we 
can rewrite R(po, I) as follows: R(po,l) = (l—q)-(r+R(p ,l)), 
where q denotes the probability that there will be not a single 
successful recommendation over the infinite sequence. This 
recurrence can be solved (i.e. lim n ^oo AT„(po, is finite) if 
and only if q > 0. 

Lemma 1. Let dilog(x) = f ^jzj dt and c — max(po,Z). 
Then, for all 1 > p > 0, q > (1 - c)exp ( ^f ( ( ^ c) ) > 0. 

Proof. The probability that there will be not a single suc- 
cessful recommendation is: 

oo oo 

g=n(i-j*-po)>n(i-c* +i ). 

k=0 k=0 

Hence it suffices to show that J^[^_ (1 — c k+1 ) > 0. Taking 
the ln( ) of both sides we get 

/ oo \ oo 

In J](1- C W) =£ln(l- C fc+1 )>-oo ! 



\k=0 



k=0 



where we need to prove this inequality. Note that the ex- 
pression ln(l — c k+1 ) is strictly increasing in k and hence 

ln(l - c k+1 ) > ^_ x Hl - ° x+1 ) dx - This S ives the bound 



J2 - c fc+1 ) = ln(l -c) + J2 H 1 



„k+l 



k=0 



k=l 
oo r k 



> ln(l - c) + / ln (! - ° X+1 ) dx 
k=1 J x =k-i 

oo j-k+l 

= ln(l-c) + 5^ / ln(l - <f +1 ) dx 
k=o ^ x=k 

= ln(l-c)+ / ln(l - c x+1 ) dx. 

Jx=0 

Recall that dilog(a;) = J^ 1 dt. The indefinite integral of 
ln(l — x) is — dilog(l — x)/\n(x). We get 



ln(1 _ c * +V - dil ° g(1 - C) - dil ° g(1 -^ +1) 



ln(c) 



lim 

x — >oo 



He) 



Since dilog(x) is continuou^ and dilog(l) = (see Lemma 
[2]) , we get 



/>oo 

/ ln(l -c k+1 )dx = 

Jx=0 



dilog(l — c) dilog(l) 

ln(c) l n ( c ) 
dilog(l — c) 

He) ' 



For < x < 1 we have < dilog(l — x) < 2e 1 + 1 (see 
Lemma [2]). For < x < 1 we have ln(x) < 0. It follows that 
/ a ~ ln(l - c k+1 ) dx > -oo. □ □ 



Lemma 2. Let dilog(x) — dt. Then dilog(x) is 

monotonously decreasing and < dilog(x) < 2e~ l + 1. 

In fact, the tight upper bound of dilog(a;) < 7r 2 /6 < 2e~ 1 + 
1 is known [5] , but we choose to give the following elementary 
proof of Lemma[2]to have a self-contained argument. 

Proof. Let f(t) = -ln(f)/(l - t). Then f(t) = -(£(1 - 
f) + ln(t))/(l - f) 2 < for < f < 1. So $t =x f(t)dt < 
!t=l + C 1 _ e_1 )/( e_1 )- For < f < er 1 we also have 

/(f) < -ln(f)/(l - e" 1 ). So, f t C f(t)dt < [f - f • ln(i)]f\ 
This is largest when x — > where the whole expression be- 
comes 2e _1 and so f t=x f(t)dt < 2e~ x + 1 for < x < 1. 
Note that /(f) is continuous at f = 1 with lim^^i /(f) = 1 
(using e.g. the l'Hopital Rule). So trivially dilog(l) = 0. As 
/(f) > this gives the desired lower bound. □ 

Using Lemma [1] we can prove the following theorem. 

Theorem 10. Let dilog(x) = f -y^r dt, c — max(po, 0> and 
<5(c) = (1 — c) exp(dilog(l — c)j ln(c)). Then, for all 1 > p > 
0, 



R(Po,l) < 



1 - 6(c) 
6(c) 



r < oo. 



This proves that even if the probability of success is reset to 
po on a single successful recommendation, the total expected 
reward over an infinite period is bounded. 

3.4 With Reset, with Recovery 

Finally, we consider the setting where g > 1 (= with recov- 
ery). Here the probability of success is set to min(po,g ■ p) 
if no recommendation was given. Hence it might be better 
not to recommend all products to avoid that that proba- 
bility p converges to zero. Let M n (p$,l, g) denote the ex- 
pected reward of the optimal strategy. To obtain bounds 
for M n (po, I, g), let us consider, as a heuristic, the algorithm 
that recommends product 1, fc+1, 2fc + l, etc. We write 
An (po, I, g) to denote this algorithm's expected profit. 

Theorem 11. Let if> be the smallest integer such that 1-gV > 
1. If k > iJj, then, for all 1 > po, I > and oo > g > 1, 

A ( n ] (poJ,g) = L^J -Po-r. 

Proof. The expected reward for the first recommendation is 
Po ■ r. Since k > ip, the expected reward for every other 
recommendation is also min(po,Po ■ I ■ 5 fe_1 ) = Po • r - Since 
there are exactly L n /^J recommendations, this shows that 
A^( Po ,l,g)^ LfJ 'POT. 



□ 



This is instructive as it shows that (a) for k > ip the ex- 
pected reward A„ (po,l,g) of does not converge as n 
tends to infinity and (b) for k' > k > if> the expected re- 
ward An \pa,l,g) of A( k ' grows slower (and is ultimately 
lower) than the expected reward A n k \po,l, g) of A^ k \ Since 
the reward M n (p ,l, g) of the optimal strategy is at least 
as high, this also shows non-convergence of R(po,l,g) — 



7 It is even diffcrcntiable as it is denned as an indefinite integral. lmin^oo M n (po, l,g) = OO. 
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Theorem 12. Let ip be the smallest integer such that l-g^ > 
1. If k < tf>, then, for all 1 > po,l > and oo > g > 1, i/iere 
exist Pq and Z' swc/i Z/iai 

lim A£ fe) (po,Z,flO < lim M n {p' Q ,l') < oo. 

n — >oo n — >oo 

Proof. If k < ip, then the profit maximization problem with 
parameters po, I, and g on the products 1, 2,3, etc. is equiv- 
alent to the profit maximization problem with parameters 
Pa = Po, I' = I ■ 9 k ~ 1 < lj and g' = 1 on the products 1, 
fc + 1, 2k + 1, etc. The claim follows from Theorem [TU1 □ 

Whereas Theorem [TT] shows that recommending too sel- 
domly is sub-optimal, Theorem 1 1 21 shows that recommending 
too often is even worse. 



4 Discussion and Future Work 

Suppose you recommend a product to a friend and the seller 
of the product offers to pay you for your recommendation. 
What would be a "good" price? Our first finding was that the 
only "truthful" price would be zero. The problem with this, 
however, is that if you do not get paid, then you might as 
well decide not to recommend the product. And so the seller 
might be willing to pay you a "fair" price. We approached the 
problem of finding "fair" prices by studying solution concepts 
from coalitional game theory such as the Core, the Shapley 
value, and the Nash Bargaining Solution. Since each of these 
solution concepts formalizes some notion of "fairness" , these 
prices can be regarded as provably "fair" . We view such an 
"axiomatic" foundation of "fairness" to be the only viable 
basis for truely "fair" prices in practice. 

Now suppose that you get paid for each succesful recom- 
mendation you make, and that you want to maximize the 
amount of money paid to you. At first sight, it might ap- 
pear that the best strategy for you is to send out as many 
recommendations to as many friends as possible. But, then, 
just as you get "blind" when being shown too many ads, 
your friends will probably start to ignore your "recommen- 
dations". We adressed this problem by modeling the loss 
in "trust" by a drop in "purchase probability" on each un- 
succesful recommendation. Our main finding here was that, 
even if the "trust" in you is reset to the initial level on a sin- 
gle successful recommendation, the total expected profit you 
can make over an infinite period of time is bounded. This 
can only be overcome if the recomendee also incrementally 
regains "trust" over periods without any recommendation. 

We believe that our work motivates a number of inter- 
esting research questions. E.g.: What are "good" pricing 
mechanisms in settings where the seller has objectives such 
as maintaining the buyer's "trust"? How exactly do web 
users respond to being shown irrelevant advertisements? Is 
it possible to revive their interest in banner ads? What are 
"optimal" auction mechanisms for sponsored search when the 
click-through-rates are non-constant and decay with each ir- 
relevant advertisement being shown? 
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